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MESSAGE HANDLING SYSTEM 
This invention relates generally to handling messages 
using electronic devices such as computer systems and in 
particular embodiments, handling telephonic and/or 
electronic mail messages. 

Messages may be forwarded to a recipient through a 
variety of sources. Telephonic messages are conventionally 
handled by answering machines or voice mail systems. These 
systems generally record the incoming voice message using 
either analog or digital formats. These systems allow audio 
playback of the incoming message. 

Computer systems may also be utilized as telephone 
answering devices. Software exists which logs incoming 
telephone calls and displays a list of those calls using 
graphical user interfaces . 

Similarly, electronic mail messages may be received 
using computer systems or other electronic devices. These 
mail messages may be displayed in a log using well known 
graphical user interfaces. 

However, there is a need for more efficient handling of 
messages in a variety of formats. 

SUMMARY 

In accordance with one embodiment, a method of 
receiving messages includes receiving electronic mail 
2 5 messages and receiving telephonic messages. The electronic 
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mail and telephonic messages are displayed together on a 
graphical user interface. 

In accordance with another embodiment, a method of 
handling telephonic messages includes identifying the source 
5 of a telephonic message. At least a portion of the 

telephonic message is converted to text. The text is 
displayed in connection with a graphical user interface. 

In still another embodiment, a computer- implemented 
method for handling messages includes identifying the source 
10 of the message. The message is then handled differently 
depending on the source of the message. 

Brief Description of the Drawings 
Figure 1 is a block diagram showing hardware in 
15 accordance with one embodiment of the invention; 

Figure 2 is a block depiction showing a data flow in 
accordance with one embodiment of the invention; 

Figure 3 is a flow chart illustrating one embodiment of 
the invention; 

2 0 Figure 4 is a graphical user interface in accordance 

with one embodiment of the present invention; and 

Figure 5 is a block diagram showing one embodiment for 
implementing the computer shown in Figure 1 . 



25 Detailed Description 

Telephonic and electronic mail messages may be received 
over a telephone line 12, shown in Figure 1. The source of 
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telephonic messages may be decoded using a caller identity 
delivery (CID) decoder 14. The decoder 14 provides 
information about the telephone number of the caller who 
originated the telephone communication. 
5 Electronic mail messages generally include a packet 

with fields that identify the caller, for example, in 
connection with conventional transmission control 
protocol /Internet protocol (TCP/IP) and other known 
techniques. The incoming communication is then received by 
10 a modem 16 which converts the information from a format 
Q suitable for communication over telephone lines to a digital 

£1 format suitable for use in connection with electronic 

^2 devices 20, such as a computer system as shown in the 

fU embodiment illustrated in Figure 1. 

□ 15 The modem 16 and CID 14 may or may not be part of the 

j\ computer 20 or other appliance with computer-like 

H 8 capabilities. The computer 20 may also be coupled to a 

q network 21 to receive electronic communications in one 

rf embodiment of the invention. 

: : a 

20 The computer system 2 0 may include call handling 

software 24 and speech-to-text conversion software 26. The 
system 2 0 may also communicate with a printer 22 by a link 
28. The link 28 may be a wire or wireless link including a 
radio frequency link or an infrared link such as that 

25 associated with the Infrared Data Association (IrDA) 
specification (www.irda.com), as examples. 
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The data flow related to the software 24, as 
illustrated in an embodiment shown in Figure 2, begins with 
the receipt of the CID information from the telephone 
system, as indicated at block 200. This information may be 
5 processed by a voice/data modem 202 which provides 

information about the source of the caller to an operating 
system 204 associated with the computer 20. Incoming data 
processing may be accomplished at block 208. 

At block 212, the software 24 may process user-selected 
10 options, for example during an initial setup sequence, which 
may include a plurality of message handling options. For 
example, the user can input a database of known callers. 
Using this database, the system 10 may handle incoming calls 
from certain callers in a different way than it handles 
15 calls from other callers. Alternatively, the database may 
be an existing database such as a corporate phone list, 
corporate e-mail list or other defined database. Similarly, 
the user can input information about device forwarding. For 
example, incoming calls may be forwarded to other electronic 
20 devices such as cellular telephones or pagers, if desired. 

Likewise, the user can program whether to completely ignore 
calls from certain telephone numbers or sources. Finally, 
in the illustrated embodiment, the user can also select a 
plurality of message options so that different message 
25 options can be displayed based on the source of the incoming 
communication . 
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The user options along with received incoming data may 
be formatted into data instructions as indicated in block 
210 and forwarded to an operating system content manager 
application 224. The content manager then may communicate 
5 appropriate display options to the video hardware subsystem 
226 to execute the appropriate video format options. 
Alternatively, speech-to-text conversion application 
software 26 may be utilized to convert the voice messages 
into text for display using conventional office software 
10 such as Microsoft Office® or Microsoft Outlook®. 
O Turning now to Figure 3, the software 24 receives 

N: incoming telephone call information as indicated at block 

300. The identity of the caller is determined as indicated 
iy at diamond 302. 

O 15 At diamond 304, a determination is made as to whether 

L the caller is a known caller. Using a database compiled in 

f* the user option setup process, as indicated at block 212 in 

O Figure 2, the identity of the caller is compared to a list 

-.f= 

2 of known callers. If the caller is not on the known caller 

2 0 list, a standard message may be played back as indicated in 
block 306. Otherwise, a determination is made at diamond 
308 whether the call should be forwarded to another 
telephone device. For example, if the caller is considered 
to be an important caller, based on information in the 
25 database, the call may be forwarded to an appropriate 

telephony device as indicated at 309. This may involve as 
an example, forwarding a message to a pager or a cellular 
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phone in an automated fashion. It may also involve sending 
a fax message using a fax modem. In still another 
alternative, an electronic mail message may be forwarded to 
a predetermined electronic mail address based on information 
contained in the known caller database. 

If the database does not indicate that forwarding is 
appropriate, a decision is made at diamond 310 whether the 
call should simply be ignored and deleted. For example, it 
may be known that a given caller repeatedly calls, but it is 
10 not desired to return the call. This information may be 
provided in the database and the incoming call is simply 
discarded. Otherwise, an appropriate message is played back 
(block 312) . The appropriate message may be determined 
through the message options in the user options setup 
15 process, as indicated in block 212 in Figure 2. Thus, 

different messages can be provided based on the identity of 
the source caller. 

If the message is accepted, the message is recorded and 
stored as indicated at block 314. The message is then 
20 converted from speech-to-text for application display as 
indicated at block 316. Thus, a least a portion of the 
message, together with the identity of the caller, may be 
converted into a text format for display on a graphic user 
interface. The graphical user interface may provide 
25 sufficient information so that the user can determine the 
nature of the call quickly and can decide how to respond. 
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Text inf ormation related to a voice message may be 
transferred to an application that is able to list 
identified incoming calls, such as an office software suite 
of the type exemplified by Microsoft Office® as indicated on 
5 block 318 and may be incorporated into an appropriate 
graphical user interface associated with such software. 

For example, the information may be provided to the 
office software in a predetermined format, for example 
having pre-defined fields recognized by the office software. 
10 At diamond 317, the software determines whether the 

Q message should be forwarded in some fashion. Message 

u= forwarding may be done in a variety of ways including an e- 

~2 mail message to another user, a pager message with the key 

jjf words and phone number from the recorded message, or even 

Q 15 parsing the message for order information or call back 
L-L information in an automated ordering system. If forwarding 

f7 is appropriate as determined, for example from a database, 

Q the message is forwarded in accordance with the 

2 predetermined protocol as indicated at block 319. 

2 0 Next, a check determines (at diamond 32 0) whether to 

provide an automated response to the message. All messages, 
or certain predetermined messages from particular callers 
may trigger automated responses. Also, callers that select 
a particular option may be responded to with an automated 
25 response. If an automated response is determined to be 
appropriate, the response may be issued, as indicated in 
block 321. 



- 7 - 



Thereafter, the flow waits for the next available call 
as indicated at block 322. The next call is handled in the 
same fashion. 

Referring now to Figure 4, a graphical user interface 
5 400 may be utilized to log and display information about 

incoming communications. In the illustrated format, which 
corresponds to common office suite software, an inbox 402 
graphical user interface is displayed in the region 404 on a 
display device such as a monitor. 

10 A list of communications may be provided in one 

embodiment of the invention in the region 404 including 
e-mail messages associated with the envelope icon 406 and 
telephonic messages associated with the telephone icon 408. 
Thus, the user can quickly see which messages were received 

15 by electronic mail and which ones were received 

telephonically . Through the voice- to- text conversion 
process, a textual display may be developed of an initial 
portion of the telephonic message together with the identity 
of the caller, if known. 

2 0 Alternatively, an audio recording of a voice message 

may be attached as a file to the converted text message. In 
this case the recipient can refer to either the textual or 
audio formats . 

The user may then click on the different messages to 

25 display a user option menu. The menu may provide selections 
for an automated response such as by telephone call, e-mail, 
or fax if the identity of the caller or sender is known. 
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Using database information the responsive communication may 
be implemented automatically. 

In some embodiments, it may be advantageous to display 
both electronic mail messages and telephonic messages in 
5 substantially the same way. This may provide an integrated 
message handling system which allows the user to deal with 
messages which were received in different ways using the 
same techniques. This integration may also simplify message 
handling and facilitate efficient disposition of messages. 

10 For example, it is not necessary for the user to use 

different software and different graphical user interfaces 
to handle different messages. Moreover, the user can 
receive a display of all the messages and can use known 
techniques to handle messages in the same way regardless of 

15 how the messages were received. 

The system may handle telephone messages and electronic 
mail messages for a single computer system. It may also be 
used in connection with larger systems which receive a large 
number of calls, for example, for order processing. The 

2 0 text of the calls may be printed out using the printer 22 
for subsequent handling. The information may be collected 
in an automated fashion to facilitate efficient disposition. 

For example, a message may be provided to callers which 
asks the caller to respond to predefined questions. Thus, 

2 5 the recipient can get the information which the recipient 
needs to process the requests from the caller in an 
automated fashion. For example, the caller may be asked to 
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say his or her name and the response is recorded. The 
caller can be asked for his or her phone number and the 
response is recorded. Then the caller may be asked pointed 
questions about the nature or purpose of the call. This 
information can then be easily formatted into an outgoing 
message, for example in text format, which may routed 
appropriately for message handling. In the order taking 
situation, the order may be immediately processed based on 
the answers to the questions posed. 

Referring now to Figure 5, an example of one embodiment 
of the system 20 is illustrated. The system 20 may include 
a processor 536, which in some embodiments may be coupled to 
an accelerated graphics port (AGP) chipset 538. AGP is 
described in the Accelerated Graphics Port Interface 
Specification, Revision 1.0, July 31, 1996 by Intel 
Corporation, Santa Clara, California. The chipset 538 in 
turn, may be coupled to system memory 540 and an AGP bus 
542. The bus 542 may in turn, be coupled to a graphics 
accelerator 544, which may be coupled to a display 546. 

The chipset 538 may also be coupled to a primary bus 
548, which in turn, may be coupled to a network card 55 0. 
The network card may enable communications with other 
computers in a network. 

The bus 548 may be coupled to a bridge 552, which in 
turn, may be coupled to a hard disk drive 554 or other 
storage medium. The hard disk drive 554 or other storage 
medium may include one or more software programs for 
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implementing the functions described previously including 
the software 24, the speech- to- text conversion software 26, 
and office suite software 565. 

The bridge 552 may be coupled to another bus 556 in an 
illustrated embodiment. The bus 556 may, in turn, be 
coupled to a basic input/output system (BIOS) 566 and a 
serial input/output (SIO) interface 558. The interface 558, 
in turn, may be coupled to a keyboard 564, a mouse 560 and 
the modem 516. 

While the present invention has been described with 
respect to a limited number of embodiments, those skilled in 
the art will appreciate numerous modifications and 
variations therefrom. It is intended that the appended 
claims cover all such modifications and variation as fall 
with the true spirit and scope of the present invention. 

What is claimed is: 



- 11 - 



